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Abstract. The Large Deviation Principle is established for stochastic mod- 
els defined by past-dependent non linear recursions with small noise. In the 
Markov case we use the result to obtain an explicit expression for the asymp- 
totics of exit time. 

1. Introduction. 

The simplest example of a stochastic model defined by past-dependent recursion 
with small noise is a linear model 

m 

Xl = Y, ai X E k _ i + eZ k (1.1) 
i=i 

subject to fixed Xf = Xi,i = 0, l,...,m — 1, where £ is a small parameter and 
(£fc)fc>m is an i.i.d. sequence of random variables. In the present paper we consider 
a general non linear model: 

XZ = f{XZ_ 1: ...,Xi_ m ,et k ), (1.2) 

where f(zi, ...,z m ,y) is a continuous function. Note that the model (1.2) includes 
(1.1) as a special case. For m = 1 the model (1.2) defines a discrete time Markov 
process. When e — > random variables X? converge to deterministic ones, say, X k 
and Xk ,k>l are determined by the recursion 

Xk = f(Xk-l, ...,Xk-mi 0) 

subject to the same initial condition. Furthermore (X^)fc> m converges to (Xk)k>m 
in the metric p(x,y) = Ylj> m i+jx~-y ■ I ' This fact provides the motivation to 
consider the large deviation principle (LDP) for family (X|)fe> TO in the metric space 
{M°°,p). For Markov case (m = 1) the LDP was considered in [5], [7] and [8]. The 
choice of the metric space (R°° , p) is a natural one for obtaining the LDP for the 
family (X|)fe> m . Recursion (1.2) defines continuous mapping (e£k)k>m — * (^|)fe>m 
in the metric p. This implies that the LDP for {Xf.)k> m follows from the LDP for 
(s&)fc>m by the continuous mapping method of Frcidlin [3] or contraction principle 
of Varadhan [11]. Since (£k)k>m 1S an i i-d- sequence, the LDP for (e£fc)fc> m holds 
if it holds for the family e£, where ^ is a copy of It should be mentioned that not 
only the rate function but also the rate of speed q(e) depends on the distribution 

fe 
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In Section 4, sufficient conditions proving the LDP for family e£ are given. Sec- 
tion 3 contains examples for which rate functions can be explicitly calculated, and 
in the Markov case asymptotics for the probability of {maxi<fc<M \X^\ > 1} is 
found (Theorem 3.1). Main results arc formulated in Section 2. One of them gives 
the asymptotics of the exit time from the interval [—1,1] for the Markov family 

2. Main results 

Following Varadhan [11], family (X E )k> m is said to satisfy the LDP in the metric 
space (M.°° , p) with the rate of speed q(e) and the rate function J(u) if 

(0) there exists a function J = J(u),u = (ui, ui, ■■■) E K°° which takes values in 
[0, oo] such that for every a > the set $(a) — {u € R°° : J(u) < a} is 
compact in (M.°°,p); 

(1) For every closed set F g (R°°, p) 

ErIg(e)logP((Xf) fe > m g F) < - inf J(u); 

(2) For every open set G g (M°°,p) 

limg(e)logP((Xf) fe > m g G) > - inf J(u). 

As was mentioned in Introduction, the LDP for {Xf.)k> m is implied by the LDP 
for family e£ (£ is a copy of Therefore, we begin with the LDP e£. Henceforth 
the following conditions are assumed to be fulfilled: 

(A.l) 

- E£ = 

- Ee'^ < oo, t g 1R "Cramer's condition". 

(A. 2) With a cumulant function -ff(£) = logEe'^ and the Fenchel-Legendre 

transform L(v) = sup teK [tu— H (t)], there exist a function q(e), decreasing 
to as e i 0, and a nonnegative function I(v) = lim £ _,o q(s)L(v / e), cGl 
with properties: 

- 7(0) = 

- lim^i^oo Z(u) = oo. 

(A. 3) If I(v) < oo for some v, then = argmax (i~ — H(t)^ is finite and 

Hrn^o — 1^1 < oo and lim s 2 H"{t £ v ) = 0. 

We notice also that the Cramer condition implies H'(Q) = and H"(t) > and 
left continuity of I(v) in a vicinity of v = mf{v > : I(v) = oo} (correspondingly, 
right continuity for v < 0). 

The main results are given 

Theorem 2.1. Assume (A.l) - (A. 3). Then: 

1) the family {e£} e ^o °^ e V s the LDP with the rate of speed q(e) and the function 
I(v) defined in (A. 2); 

2) the family {(e^k)k>i}e— >o obeys the LDP in the metric space (R°°,p) with 
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the rate function (v = (vi, V2, — ) € M°°) 

00 

fc=l 

3) the family {(X|)fc> m } E _,.o obeys the LDP in the metric space (R°°,p) wit/i £/ie 
raie function (u = (u m , u m +i, ...) € R°°) 

{00 

I] inf ^(ufc), = a;i,i = 0, ...,m - 1 

00, otherwise, 
where inf(0) = 00. 



Remark 1. Some time (A.l) - (A. 3) might be readily verified if £ obeys a de- 
composition £ = + with independent random summands satisfying the Cramer 
condition. If for £ l the Theorem conditions are satisfied (with q l (s), P(v)) and 

lim q i {e)L il (v/e) = -00, v ^ 0, (2.2) 

then the theorem statement is valid the rate of speed q(e) = q l {e) and the rate 
function I(v) = P(v). 

Condition (2.2) always holds for random variables with a finite support. 

Remark 2. The requirement for f(z\, z m , y) to be continuous can be relaxed if 

H s (t, zi, ...,z m ) = logEcxp (tf(zi, ...,z m ,s£ifj 

is continuous in Zi, ■-,z m for every fixed t and e, and there exists a norming factor 
q(s), that is, 

lim q(e) sup[tu -H e (zi,..., z m )\ = I(u, zi, z m ). 
ten 

Then, the LDP for the family {(X|)fc> m }e_>o ma y hold with rate function 

Jco{Ul,U 2 , ■■■) = 2J I{uk,Uk-l, ...,Uk-m)- 

The asymptotics for exit time is our next result. Let 

subject to Xq = and £1 is (0, 1)-Gaussian random variable. Denote t £ exit time 
from the interval [—1,1], 

r e = min{fc > 1 : > 1}. 

Theorem 2.2. J/ \a\ < 1, then Iim e ^ £ 2 log Er e < ±(l-a 2 ). 

Remark 3. The statement from 1) related to a discrete time version of the Freidlin- 
Wcntzell result on of the exit time asymptotics for diffusion processes [4] while a 
corresponding discrete time version can be found in Kifcr, [6]. Unfortunately, we 
could not apply Kifcr's result since in [6] X^. take values in a compact while in our 
case € R. Therefore, repeating some details from [6], we give a self-contained 
proof. 
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3. Examples and Applications. 

Example 3.1. The rate of speed q(e) = e 2 and the rate function I(v) = \v 2 
correspond to the family {e£} e _»o with (0, 1)-Gaussian random variable with the 
cumulant function H(t) = \. At the same time the pair q(e) — e\ loge|, I(v) = \v\ 
correspond to the Poisson random variable £ with parameter 1 and the cumulant 
function H(t) = e* + e"* - 2. 

It is interesting to note that for £ = + £ M , where and are independent 
random variables: 

- is the Gaussian(0, 1) random variable, 

- is the Poisson(l) random variable, 

then the LDP for family {££} £ _>o holds with q(e) = lo g £ and I(v) = \v\. 

Example 3.2. For a linear in y function f(z\, ...,z m ,y), involving in (1.2): 

f(zi, z m , y) = a(zi, z m ) + b(zi, z m )y, 

with positive b(z\, z rn ), and Gaussian(0, 1) random variable £i the rate function 
is defined as: 

("fc-n("fc-i,-..,"fc-m) 2 _ _ 

Z-fc=m h^( tlfc _ 1 ,...,« fc _ m ) . u -a:o,...,« OT -i-x m - 1 
oo, otherwise. 

It can be shown, in particular, that the above formula for the rate function is 
preserved if b{z\, z m ) equals zero for some (z\, z m ) provided the convention 
0/0 = 0. 

In the case of the Markov model XjF = a{Xf,_ 1 ) + b(X k z _ 1 )e£ > k 1 an analogy to 
Freidlin-Wentzell's result [4] for the diffusion dXf = a{Xf)dt + eb(X^)edW t (W t is 
Wiener process) holds. Namely, 

oo, otherwise. 

3. The next result plays an important role in proving Theorem 2.2, it also has an 
independent interest. Notation P Xo will be used for designating 'Xq = xq'. 

We consider the model 

X% = aXl_ 1 +e^ k . 

Theorem 3.1. Let the assumptions of Theorem 2.2 be fulfilled and M > 1. Then, 
lime 2 log P ( max \Xi\ > l) = ^ . 

In particular, for \a\ <1, 

1 



lim£ 2 logP ( max IXf I > l) = -^(1 - a 2 ] 

e^o 6 v i<fe<M 1 fcl ~ ' 2 V ; 



1 - a 2M 



Proof. The family {(-^f )jfe>i} e — >o obeys the LDP with the rate of speed e 2 and the 
rate function 

\ J2kLi[ u k - a«n] 2 , M = 
oo, otherwise. 

Denote by 

21m = {u :3k < M with \u k \ > 1 and Uk+i = auk, V k > M}. 



Joo(u) 
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Obviously, any sequence (u n ) n >i from 21a/ converging in the metric p has a limit 
u G 21m, that is, 21m is a closed set. Hence, due to the LDP, 

lime 2 log P( max \Xi\ > 1 ) < - min Joo(u). 

e^O \l<k<M ) «e2C M 

If u' G 2l A /, then u' fe+1 = au' k , V fc > M, so that, J 00 (ti') = Jm(u'). If u' G 21a/, 
then, there exist a number r' = inf{l < k < M : \u' k \ > 1}. Since J T '(u'), < Jm(u') 
we may restrict a minimization procedure up to 

min J T i{u') — min J T i(u) (3-1) 

^Q— 0,|U^_/ |>1 Uq— 0,|u^.,|— 1 

l u it |<l,fc<r'-l |M' fc |<l,fe<r'-l 
r'<M t'<M 

The proof of (3.1) is based on the fact that the lower bound for min J T > (u 1 ) 

u' — 0, \u' 1 1 > 1 
|u' fc |<l,fc<r'-l 
t'<M 

is attainable on min u ' g=0 |„' ,| =1 . 

M' fc |<l,fc<T'-l 

To this end, by letting 

u' k = au' k _x + Wk, uo = 0, k < t', 
we find that u' T , = X)fe=i flT ~ fcu; fe an d by |u r '| > 1 and the Cauchy-Schwartz 



inequality 1 < y X}fe=i a2( - T ' fc ^ Sfe=i ^fc- ^ n other words, 

V- 2 1 1 1 



fe=i 



where the equality is attainable for w k = Ka M ~ k with free parameter K is chosen 
such that to keep \u' T ,\ — 1 or \u' T ,\ > 1 respectively. Thus, both sides of (3.1) 
possesses the same (attainable) lower bound: aj -i 2fc an d, due to the LDP, 

2 2^fc=o a 

liinVlogPf max \Xi\ > l) < . 

In order to prove the lower bound 

h^ £ 2 logp( i max M |^| > l) > 

we introduce an open subset of 21a/ : 

2l M = {u : 3k < M with \u k \ > 1 and u k +\ = au k , k > M}. 
So, due to the LDP, 



lime log P max \X k \ > 1 > -_min Joo{u). 

6 —>Q V l<fc<A'/ / u€:*&° M 

As previously, min^a^ J^u) = nim^a^ J M (u) and, moreover, 

1 T 

_min Jm(u)~— min \ (u k — au k -\) 2 = min J T i(u). 

2 « =0,|« T |>1 f— ' u[,=0,|t/,| = 1 
|« fe |<l,fe<T-X '- \u' k \<l,k<r'-l 

T < M r'<M 



(i 
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So, it is left to notice that for \a\ < 1, 

A/-1 



T a 2k = -^\l-a 2M ]. 

1 — a 2 J 



fc=0 

□ 

4. LDP for e£ 

In this Section, we prove statement 1) of Theorem 2.1. 

There are different approaches for proving the LDP (see e.g. [1], [2], [9]). In 
our case, following Puhalskii's main theorem, ([14], sec also Theorem 1.3 in [10]), 
it suffices to prove the exponential tightness: 

lim limg(e)logP(|e^| > c) = -co, (4.1) 

c— *oo e— >0 

and the local LDP: for every oeK 
lim lim q(e) log P(|e£ — v\ < 5) = lim lim q(e) log P(|e£ — v\ < 6) = —I(v). 



(4.1) is equivalent to 

lim lim q(e) log P( ± e£ > c) oo. 

c—>oo e— >0 

By the Chernoff inequality P(e£ > c) < exp ( — {tc)/e + H(t)) and due to 

sup[t(c/e) - H(t)] = sup[t(c/e) - H(t)] 
t>o teR 

and (A. 2) we find that lim e ^o q(s) log P(e£ > c) < —/(c) ► -co. The proof of 

c — >oc 

lim ^ , n q(e) log P(— e£ > c) < —1(c) > — oo is similar. 

c— >oo 

The local LDP is proved in two steps: 

1) lim lim ofe) log P(|e£ - v\ < 6) < I(v) 

2) lim lim q(e) logP(|e£ - v\ < 6) > -I(v). 

Set Z = exp (t£ — H(t)). Since EZ = 1, for the proof of 1) we apply an obvious 
inequality EI(\£ — u/e\ < S/e)Z < 1 which remains valid with Z is replaced by its 
lower bound Z = exp ( - (8/e)\t\ +t(u/s) - H(t)) on the set {\£-u/e\ < 5/e}. The 
latter provides 

q(e) logP(|£ - v/e\ < S/e) < q(e)(S/e)\t\ - q{e)[t(v/e) - H(t)}. 
and, due to (A. 2) and (A. 3), 1) holds. 

For 2), it suffices to check only the validity of 2) for v with I(v) < oo. 

Let us denote P(y) the distribution function of £. Set A t (y) = exp (ty — H(t)). 
Since J R At(y)dP(y) = 1 one van introduce new distribution function Qt(y) which 
obeys the following properties: 

[ ydQ t (y)=H'(t) and / [y - H' \t)] 2 dQ t (y) = H" (t). (4.2) 

J R J R 
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Since I(v) < oo, t% is a number. Then, by taking t = t E v , we find that 

P{H-v\<5) = f exp(-tly + H(t s u ))dQ t s(x) 

Ay-(v/e)\<(S/e) 

> exp(-\t s v \(5/e)-t s v v + H(tl)) 



x / dQ t e (x). 

l\x-(v/e)\<{6/ E ) 



Hence, 2) holds if. for instance, 



lim / dQ t *(x) = 1, 5 > 0, 

J\x-(v/e)\<(5/e) 



l\x-(v/e)\<(S/e) 

while the latter is verified with the help of Chebyshev's inequality, (4.2) and (A. 3): 

dQ t e (x) = 1 - / dQ v (x) 

\x-(v/e)\<(6/e) J\x-(u/e)\>(5/ E ) 



S 2 



> 1 - / (x~u/e) 2 dQ ti (x) 



-> 1, £->0. 

5. LDP for (e^ fc )fc>i 

For n > 1, the LDP for the family (e£fc)i<fc< ra in the metric space (M. n ,p n ), 
where for x,y 6 R n p n {x, y) = J2k=i \ Xk ~ Vk\ w ^ n * ne rate °f s P ee d ?(e) and the 
rate function 



I n (v n )=J2l(v k ) 



k=l 



holds due to the vector (e£fc)i<fc<n has i.i.d. entries (see [12]). Next, by Dawson- 
Gartner's theorem (see [13] or [1]), the LDP for family (e^k)k>i holds with the 
same rate of speed and the rate function 

oo 

m = Y / i(vk). 

k=l 

6. LDP for {Xl) k > m 

The mapping {e^h)k>m (-^|)fe>m is continuous in the metric p. Therefore, by 
the contraction principle (continuous mapping method) (see [3] and [11]) the family 
(X^.)k>m obeys the LDP with the same rate of speed and the rate function 

J<x>(u) = inf Ioo(v), 

(v k ,k>m:u k = f(u k _ 1 ,...,u k _ m ,v k )) 

where inf{0} = oo and Ioo{v) is defined in (2.1) and 

oo 

(v k ,k>m:u k =f(u k _ 1 ,...,u k _ m ,v k ) f (v k ,k>m:u k =f(u k ^ 1 ,...,u k _ m ,v k )) 

k—m 
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Remark 1 holds true since by (2.2) the random variable £f is exponentially 
negligible with respect to the norming factor q l (e): for any S > 

hW( £ )logP(| £ £fl >S)=-oo. 

7. Asymptotics of exit time. 

In this Section we prove Theorem 2.2 

Let M be an integer. It is clear that e 2 logEr e and e 2 logE^j have the same 
asymptotics as e — > 0. 

By taking into account [z] < z < [z] + 1, where [z] is integer part of z, write 

< E a +1 



M ~ IM 

OO 



I 



>n +1 



n=l 

oo 



n=l 
oo 



< p ( t£ > Mn ) + L 

n=0 

This upper bound implies the desired statement if 



lim lim e 2 log V pfr > Mn) < -(1 - a 2 ). 

f— too e— >0 V / 2 



A/ 

71 = 



In order to establish the above upper bound, we use and an obvious equality 



P (t £ > Mn) = P max \Xl\ < 1 



and the Markov property of (-X"|)fc>i : 



P( max \Xi\ < 1) 



= E-f/( max |X, e | < 1)P X * ( max IXEI < 
The time-homogeneity of X| implies 

Ij\ X ' l<uPx e I max \Xt\ < 1) 



< I{\X' ,J<i} sup P x ( sup \X £ k \ < 1 

( ' \x\<l V 0<fc<M 



< 



M(n-l) -f\ |aj|<l V 0<fe < M 

= % Vl) |<i((l-Po( sup |Jf||>l 



• 0<k<M 

where the latter equality is provided by zero mean Gaussian distribution of Xf., 
k = 1,...,M. 

Hence we obtain the recurrence relation 

P(r £ > Mn) <P(t £ > M(n - 1)) (l - Po^max^ |Xf | > 1 
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with P(r e > 0) = 1. Iterating it, we find that for any n > 1, 
P(r e > Mn) < 

Thus, 

oo 

P{r e > Mn) 

n=0 

and it is left to apply Theorem 3.1 

Acknowledgment. Authors would like to thank anonymous reviewer for his com- 
ments which lead to correction of mistakes and misprints and improved the paper. 
Added March 2006. The authors are grateful to Goran Hognas and Brita Ruths 
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1 - P ( max \Xl\ > 1 



< 



P (maxi< fe <M > l) 

□ 



